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^.,^i Abstract. In this paper, it is proved that every s-sparse vector x £ R" 

j^ ' can be exactly recovered from the measurement vector z = Ax G R™ 

via some ^'-minimization with < g < 1, as soon as each s-sparse vector 
X G R" is uniquely determined by the measurement z. 
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1. Introduction and Main Results 



Define the norm ||x||g,0 < q < oo, of a vector x = {xi, . . . ,Xn) G 
y^ • R" by the number of its nonzero components when q = 0, the quantity 

(|xi|'' + • • • + l^nl'')^'^ when < q < oo, and the maximum absolute value 
max(|xi|, . . . , |x„|) of its components when q = oo. We say that a vector 
V^ . X G M" is s-sparse if ||x||o < s, i.e., the number of its nonzero components 

t^ ' is less than or equal to s. 

\o' 

O 



In this paper, we consider the problem of compressive sensing in finding 
s-sparse solutions x E M"' to the linear system 



in 

o : (1.1) Ax 



z 

via solving the ^''-minimization problem: 

(1.2) min ||y||g subject to Ay = z 

where 0<g<l, 2<2s<m-<n, Aisanmxn matrix, and z G M"* is the 



.•^ ; observation data ( [D El El El ISl [Hj ) . 



One of the basic questions about finding s-sparse solutions to the linear 
system (|1.1|) is under what circumstances the linear system p.l|) has a unique 
solution in S^, the set of all s-sparse vectors. 

Proposition 1.1. ( |12t I15j ) Let 2s < m < n and A be an m x n matrix. 
Then the following statements are equivalent: 

(i) The measurement Ax uniquely determines each s-sparse vector x. 
(ii) There is a decoder A : M'" i — > W^ such that A(Ax) = x for all 

X G S^. 
(iii) The only 2s-sparse vector y that satisfies Ay = is the zero vector. 
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(iv) There exist positive constants a2s and /32s such that 

(1.3) a2s||x||2 < ||Ax||2 < /32s||x||2 for all X G S2s- 

The first contribution of this paper is to provide another equivalent state- 
ment: 

(v) There exists < q < I such that the decoder A : M™" i — > M"' defined 
by 

(1.4) A(z) := argminAy=z||y||5 
satisfies A (Ax) = x for all x G S^. 

The implication from (v) to (ii) is obvious. Hence it suffices to prove 
the implication from (iv) to (v). For this, we recall the restricted isometry 
property of order s for an m x n matrix A, i.e., there exists a positive constant 
5 £ (0, 1) such that 

(1.5) (l-(^)||x||^ < ||Ax||^ < (l+5)||x||^ forallxGS,. 

The smallest positive constant 6 that satisfies (jl.Sp . to be denoted by 6s{A), 
is known as the restricted isometry constant O [7]. Notice that given a 
matrix A that satisfies (|1.3p . its rescaled matrix B := ^J^jia^^ + /32s)A 
has the restricted isometry property of order Is and its restricted isometry 
constant is given by (/3|^ — a^s)/!"^!* + /^2s)- Therefore the implication from 
(iv) to (v) further reduces to establishing the following result: 

Theorem 1.2. Let integers m,n and s satisfy 2s < m < n. If A is an 
m X n matrix with 52s(A) G (0, 1), then there exists < g < 1 such that 
any s-sparse vector x can be exactly recovered by solving the i'^ -minimization 
problem: 

(1.6) min||y||g subject to Ay = Ax. 

The above existence theorem about ^''-minimization is established in [17] 
and [9] under a stronger assumption that 52s+2(A) G (0, 1) and J2s+i(A) G 
(0,1) respectively, as it is obvious that 52s(A) < 52s+i(A) < 52s+2(A) for 
any m x n matrix A. 

Given integers s, m and n satisfying 2s < m < n and an m x n matrix A, 
define 

qs{A.) := sup {g G [0, 1]| any vector x G S^ can be exactly recovered 

(1.7) by solving the i'^ — minimization problem (jl.6p }. 

Then (?s(A) > whenever (52s (A) < 1 by Theorem ll.2[ It is also known 
that any s-sparse vector x G M"" can be exactly recovered by solving the 
^'^-minimization problem (II. 6p whenever q < (?s(A) [18]. This establishes 
the equivalence among different q G [0,gs(A)) in recovering s-sparse so- 
lutions via solving the ^'^-minimization problem (II. 6p . Hence in order to 
recover sparsest vector x from the measurement Ax, one may solve the 
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^'^-minimization problem ()1.6p for some < g < 1 rather than the i^- 
minimization problem. Empirical evidence ([9l [22| I23j ) strongly indicates 
that solving the ^'^-minimization problem with < g < 1 takes much less 
time than with q = 0. 

The ^^-minimization problem is a combinatorial optimization problem 
and NP-hard to solve |20j . while on the other hand the ^^-minimization 
is convex and polynomial-time solvable [2]. To guarantee the equivalence 
between the i^ and ^^-minimization problems (\1.6h in finding the sparse 
vector X from its measurement Ax, one needs to meet various require- 
ments on the matrix A, for instance, 5s(A) -|- (52s (A) + ^Ssi-^) < 1 in 

0, dssiA.) + 3(54s(A) < 2 in [5], and 52s{A) < 1/3 w 0.3333, ^/2 - 1 ^ 
0.4142,2/(3 + V2) « 0.4531,2/(2 + V^) ^ 0.4731,4/(6 + VQ) ^ 0.4734 in 
[121 m \T7\ [3l [16] respectively. Many random matrices with i.d.d. entries 
satisfy those requirement to guarantee the equivalence [7], but lots of de- 
terministic matrices do not. In particular, matrices A^ are constructed in 
|13| for any e > such that (52s(Ae) < l/\/2 -|- e and that it fails on the 
recovery of some s-sparse vectors x by solving the ^^-minimization problem 
()1.6p with A replaced by A^. 

The ^'^-minimization problem (II. 6p with < g < 1 is more difficult to 
solve than the ^^-minimization problem due to the nonconvexity and nons- 
moothness. In fact, it is NP-hard to find a global minimizer in general but 
polynomial-time doable to find local minimizer [19j. Various algorithms have 
been developed to solve the ^'^-minimization problem ()1.6p . see for instance 

[EiiiiiiiiiiiaEi]. 

For any 5 £ (0, 1), define 

(1.8) Q'max(5;m,n, s) := inf qs{A). 

52siA)<6 

Then given any positive number q < gmax('5; rn, n, s) and any m X n matrix 
A with (52s (A) < <J) any vector x S Ss can be exactly recovered by solving 
the ^''-minimization problem ()1.6p . For any < g < 1 and sufficiently small 
e, matrices A^ of size (n— 1) x n are constructed in [13] such that (52s(Ag_e) < 

2_^''_ \- e and there is an s-sparse vector which cannot be recovered exactly 

by solving the ^'^-minimization problem (jl.Op with A replaced by A^^^, where 

rjq is the unique positive solution to rjg -|- 1 = 2(1 — r]q)/q. The above 
construction of matrices for which the ^'^-minimization fails to recover s- 
sparse vectors, together with the asymptotic estimate r/g = 1 — qxQ + o{q) as 
(7 — )• 0, gives that 
(1.9) 

limsup ^— ^^' "-/'"' ^^ < hm ^(' - ^ - ^'^^ = -^— « 3.5911, 
S^i- 1 - (5 g^o+ 2- q-2r]g 2x0-1 

where xq is the unique positive solution of the equation e~^^ = 2x — 

1. The second contribution of this paper is a lower bound estimate for 
g'max(5; m, n, s) as (5 -> 1-. 
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Theorem 1.3. Let gmax('^; "i, n, s) be defined as in ()1.8I) . Then 

(1.10) liminf ^"^""^'^'"';''''^^ > - « 0.6796. 

Denote by V5 the vector which equals to v G M" on S and vanishes on 
the complement S'^ where S G {1, . . . ,n}. We say that an m x n matrix A 
has the null space property of order s in i'^ if there exists a positive constant 
7 such that 

(1-11) \\hs\\q<7\\hs4q 

hold for all h satisfying Ah = and all sets S with its cardinality ^S less 
than or equal to s ([12]). The minimal constant 7 in (jl.lip is known as the 
null space constant. 

For < g < 1 and 6 G (0, 1), define 

, J-. . r ( 'i^ + roS 2y 

aiq.d) := mt max < t-. — — 1-, sup —r, 

0<ro<l I (1 + ro«<5'?)l/<? ^^,_,^)s/2<y<l (l + 2-''/2y2+<?)l/5 

(1.12) sup -1-, sup -^>. 

V2{i-ro)5/2<y<i (1 + y) '" ^<y (1 + y) ^^ -" 

The third contribution of this paper is the following result about the null 
space property of an m x n matrix. 

Theorem 1.4. Let q be a positive number in (0,1], integers m,n and s 
satisfy 2s < m < n, A be an m x n matrix with 52s (A) S (0, 1), and set 

^'■''^ '^•=(tTma)) • 

Then A has the null space property of order s in i'^ , and its null space 
constant is less than or equal to a{q,6i)/6i. 

The fourth contribution of this paper is to show that one can stably 
reconstruct a compressive signal from noisy observation under the hypothesis 
that 

(1.14) a{q,6i)<Si. 

Theorem 1.5. Let m, n and s be integers with 2s < m < n, A be an mx n 
matrix with 52siA) G (0, 1), e > 0, g G (0, 1] satisfy (J1.14p with 5i given in 
(jl.lSp . and X* be the solution of the i"^ -minimization problem: 

(1.15) min ||x||g subject to || Ax — y||2 < e 



where y = Ax+z is the observation corrupted with unknown noise z, ||z||2 < 
e and x is the object we wish to reconstruct. Then 

(1.16) ||x* - x||2 < Cosi/2-^/«||x - x,||g + Cie, 
and 

(1.17) ||x* - x||, < C72||x - x,||, + Cs^i/^-i/^e, 
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where x^ be the best s-sparse vector in M" to approximate xq, i.e., 

Ilxo — xlL = inf llx' — xlL 

and Ci,0 <i<3, are positive constants independent on e,x and s. 

The stable reconstruction of a compressive signal from its noisy observa- 
tion is established under various assumptions on the restricted isometry con- 
stant, for instance, (53s(A)-|-3(54s(A) < 2 and (7 = 1 in [5], and (52s (A) < V^— 
1 and g = 1 in [4], 62t{A) < 2(^/2- l)(t/s)i/9-V2/(i + 2(V2-l)(t/s)V9-i/2) 

for some t> s and < g < 1 in [17], and 4.(A)+fc2/P-M(fe+i)s(A) < k'^^i-l 
for some k £ TLj s and < g < 1 in [22^ 



As an application of Theorem 11.5^ any s-sparse vector x can be exactly 
recovered by solving the ^'^-minimization problem (I1.6P when q G (0, 1] sat- 
isfies (fTTi]) . 

Corollary 1.6. Let m, n and s be integers with 2s < m < n, A be an mx n 
matrix with 52s (A) £ (0, 1), e > 0, g G (0, 1] satisfy (|1.14|) with 5i given in 
(I1.13p . Then any s-sparse vector x can be exactly recovered by solving the 
l'^ -minimization problem 



Let 

gsuccC'^) = gmax(\/(l-'^)/(l + '^)) 

where qms,Ki^i) = sup{g G (0, 1]| a{q,5i) < 5i}, and let gfaii((5) be the solu- 
tion of the equation 

[2-q)5 Y/i 2-26 + 2q6 

1 + 6 ) ~ q + q5 

if it exists and be equal to one otherwise. Then by Theorem 11.5^ any s- 
sparse vector x can be exactly recovered by solving the ^'^-minimization 
problem ()1.6p when q < gsucc('52s(A)), while by [l3] there exists a matrix 
A with (52s (A) < (5 and an s-sparse vector x such that the vector x cannot 
be exactly recovered by solving the ^'^-minimization problem ()1.6p when 
Q > '?faii('5). The functions gsucc((5) and gfaii((5) are plotted in Figure [H 

2. Proofs 
In this section, we give the proofs of Theorems 11.21 11.31 11.41 and II. 5[ 



2.1. Proof of Theorem 11.41 To prove Theorem 11.41 ^^ need three tech- 
nical lemmas. 



Lemma 2.1. Let 0<g<l,0<c<l and a,b> 0. Then 

v^ f fc + a a + c } / -s—^ 

(2.1 a+> f I, < max < max rr^, rr^ M + / t 

^ ' Z^ " - li<fc<m(A; + 6)i/'?' (5 + c9)V9/V ^ 

holds for any (ti, . . . , tm) G [0, 1]"* with ti + ■ ■ ■ +tm> c. 
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Figure 1. The function gsucc((5) is plotted in continuous line, 
while the function q^ii^) is plotted in dashed line 



Proof. Define 



(2.2) Fq^a,b,c{^,n) 



sup 

(ti,...,i™)e [0,1]^ 

tl H \-tm>C 



n 



+ a + Er=i tk 



in + h + YJLAY''^' 



By the method of Lagrange multiplier, the function {n + a + YlT=i ^k){fi + 
^ + SfeLi ^fc)^^ attains its maximum on the boundary or on those points 
(tl, . . . ,tm) whose components are the same, i.e., 

Fq,a,b,c{'m,n) = max|Fg,a,6,o("i- 1,"- + l),-^g,aAc("T'- I,"-), 

— ] 



n + a + mt 

sup 7 ; , 

c/m<t<i (n + 6 + mfi) 



As the function {n + a + mt){n + h + mt'^)"^''^ has at most one critical point 
and the second derivative at that critical point (if it exists) is positive, we 
then have 



-^q,a,b,c(m',n) = max|Fg,a,6,o("^- l,n + l),Fq,a,6,c("T'- l,ra). 



(2.3) 



n + m + a 



n + a + c 



{n + m + by/ii ' (n + 6 + m^-^c'?)!/'? 



}■ 
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Applying (12.30 iteratively we obtain 

Fq,a,b,c{m,n) = vcLW^iyFq^a,bfl{m-2,n + 2),Fq^a,bfl{m-2,n + l), 

„ , ^ . n+l+a n+m-l+a 

Fq,a,b,c{m-2,n), 



(n + 1 + 6)1/9 ' (n + m - 1 + 5) V? ' 
n + m + a n + a + c ~i 

(n + m + 6)1/9 ' {n + h + {m- l)i-'?c'?)Vg J 

max|F<y^a^b^o(l,'^ + "i- I),--- ,Fq,a,bfi{'^,n + 1), 
n + a + c 



-?^g,aAc(l,"-), 



(n + 6 + 21-909)1/9' 

n + m + a n + 2 + a n+l + a i 

(n + m + 6)1/9 ' " ' ' (n + 2 + 6)1/? ' (n + 1 + 6)i/9 / 

,^. r n + /c + a n + a + c-i 
(2.4) = max<^ max ; ttt^jT ; rr^ ^ 

l i<fc<m (n + A; + 6)i/9 (n + 6 + c9)i/9 J 

Then the conclusion ()2.ip follows by letting n = in the above estimate. D 

Lemma 2.2. Let < (7 < 1, ci, C2 G [0,1] and ai,bi > for i = 1,2,3. 
Then 

m 

ax + a2X + asy + y^ tfc 
fc=i 
r ai + a2 ai + a2Ci ai + a2 + (as + l)c2 

- ^^'^ I (61 + 62)1/9 ' (61 + 62C?)i/9 ' oIkL (61 + 62 + (63 + /)cl)i/9 ' 

^O r;\ ai + a2Ci + (as + /)C2 \ ^ /, ,, „,, q,^+l\'l'^ 

(2-5) sup /, ^, 9^/, ^A 9M/q r ^ (^i + ^2a;^ + ^3y^ + Z^^fc) 

0<Km (61 +62CI + (63 +/)C^)1/9J V ^ ^ 

/loWs for all < ti, . . . ,tm < y, ci < x < 1 and < y < 02- 

Proof. Note that the maximum values of the function (a + ht)/{c + dt'^Y''^ 
on any closed subinterval of [0, 00) are attained on its boundary. Then 

ai + a23: + a^y + Y^Z=i ^k 
(6i + 62x9 + 6sy9 + ^-^^t9)i/, 

ai + a2X + (as + l)y 



sup 



Q<l<m{hl + b2X'i + {b^ + l)ylY/l 

ai + a2X ai + (as + l)c2 + a2X 



max 



f ai + a2X ai + (as + tjC2 + a2X 1 

I (61 + 62X9)1/9 ' o| K^™ (61 + (6s + l)cl + 62X9)1/9 / 

r ai + a2 ai + a2Ci ai + a2 + (as + l)c2 

- ^^"^ \ (p^ + h2Yl'i ' (61 + 62C?)l/9 ' o^Km (61 + 62 + (6s + /)c^)l/9 ' 

ai + a2Ci + (as + l)c2 



sup 



0<i<^{hi + h2cl + {h + l)clY/<i 



}. 
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and (P3]l follows. D 

Lemma 2.3. Let 0<q'<1, s>l be a positive integer, and let {clj}j>i be 
a finite decreasing sequence of nonnegative numbers with 

(2.6) Y.{t''i,.y''>i±Mf" 

fe>l j=l i=l 

for some 6 G (0, 1). Then 

(2.7) E (E«M''' ^ a('/,'^)^^/^-^/^(E «?)'''' 

fc>i «=i j>i 

where a{q,5) is defined as in (J1.12p . 

Proof. Clearly the conclusion (j2.7p holds when a^+i = for in this case the 
left hand side of (j2.7p is equal to 0. So we may assume that a^+i 7^ from 
now on. Let rg be an arbitrarily number in (0, 1). To establish (|2.7p . we 
consider two cases. 

Case I: X]fc>2 "fcs+i > 'ro'^as+i- 
In this case, 

I2k>i{Y^i=i"'ks+i) ^ ^ Z]fe>i"fcs+i 



< 



_ 1/2-1/q -*- "*" ^k>2 Qfcs+l/fls+l 

^ 1/2-1/g r l + ro(5 fc + 1 -1 

< s ' ' ^ max i ^, — —-r- , max —-r- > 

I (1 + r^6iy/i fe>i (A; + l)i/g J 

(2.8) = si/2-i/g(;^^^^^)(;^^^g^g)-i/g^ 

where the first inequality holds because {aj}j>i is a decreasing sequence of 
nonnegative numbers, the second inequality follows from Lemma 12. H and 
the last equality is true as (1 + t)(l + t'^)~^''^ is a decreasing function on 
(0,1]. 

Case II: Y.k>2'^ks+i < ro5as+i. 

Let So be the smallest integer in [1, s] satisfying 0^+^0+1 /os+i < (so/s)^ ■ 
The existence and uniqueness of such an integer sq follow from the decreasing 
property of the sequence {as+so+i/ci's+iYsQ=i, the increasing property of the 
sequence {(so/s)^^^}fo=i, and as+so+i/o-s+i < (so/s)^''^ when sq = s. Then 
from the decreasing property of the sequence {aj}j>i and the definition of 
the integer sq it follows that 

(2.9) as^^^s_o^y/2 

tts+i S 
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and 



V2sl^'^as+i > (soa^+i + (« - «o)— a^+i)^^^ - (Yl 



' 2 NV2 

^ i=l 



1=1 k>2 1=1 



k>2 



which imphes that 



(2.10) so > ^ :^ s. 



Applying the decreasing property of the sequence {oj} and using the in- 
equahty {ea"^ + (1 - 61)62)1/2 < ^1/2^ + (1 - 0^/'^)b where a > 6 > and 
^ G [0, 1], we obtain 



»-"'vfv«u:'" 



T(E' 

fe>l i=l 

< s"^^^ ((so - l)as+i + Qs+so + (s - so)as+so+i) 
+s~i/2 ^ (so4^+i + (s - so)aL+so+i)^ ^ 

k>2 
, /i^/SO-1 2 1 2 V^^ , fl l~^\ 



fc>2 



+ 2_/ ( V ""^fes+l + ( -^ ~ V ~ ) ^ks+so+l 



/OiiA ^ /so- 1 , v^ - V-50 - 1 , -^ 

(2.11) < A/ fls+l H ^ Os+si, + 2^ Ofes+so+l' 



fc>l 



and 



i>i 



(2-12) +«s+so+i + ^E« 



9 

fes+so+l' 
fc>2 
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Combining ()2.1ip and ()2.12p , recalling (12. 9p and the definition of the integer 
So, and applying Lemma fl?2\ with ci = ^/{so — l)/s and C2 = \/ sq/s, we get 



s 



l/q-l/2 ^fc>l \ Z-^i=l ^ks+i) 



sn — 1 I v^~v'*0~l Y^ 

^— Os+l H ^75^ «s+so + «s+so+l + l^k>2 0-ks+so+l 

((1 + l/s)a^+i + (so - lX+,„/s + a^+,o+i/s + Efc>2 oL+so+i)^^'' 
< max 



k 



s V " \ v^ 



iVg' /I , 1 /„ , //„ 1^/„M+o/2^V'^' 



sup ■ 



(1 + So/sy' (1 + 1/s + ((so - l)/s)l+''/2)^ 

(/ + 2)./^ 



i>o (i + so/s + (/ + i/s)yf; 



1/g' 



(2.13) sup ^ -^>. 

'^0 (((/ + l/s)7f + 1 + l/s) + ((so - l)/s)l+9/2)^/« J 

Therefore 

Z^fc>i (z^j=i '^fcs+J 



X..i«l)''^ 



a/2-i/g. 



k 



Vso/s y/so/t 



1/9' /1 , o-o/2/'„„/.M+o/2AV'?' 



(1 + So/s)'^'^ (l + 2-'?/2(so/s)l+9/2) 



(/ + 2)yso7s (/ + 2)ysoA 

sup — , , sup 



^>o (i + so/s + ZyV^)'/^ ^>o {i + l./J^s + 2-i/^{so/sy+'i/^f''' 



} 



< si/2-V</ 



s ' ' ^ max < sup 



{ 



2y 



v^(l-ro)5/2<y<l (1 + 2-9/2^2+9) 1/g' 
(2.14) sup —J-, sup T^f' 

V2(i-ro W2<j/<i (1 + y) " ^<y (1 + y) '" ^ 

where the third inequality is valid by (j2.10p and the first inequality follows 
from the following two inequalities: 



and 
(2.16) 

1 /t-l\l+g/2 /lNl+g/2 /t_lNl+g/2 /txl+g/2 
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The conclusion ([221) follows from (H^D and (f2Ti]) . D 

Now we give the proof of Theorem 11.41 
Proof of Theorem \1.4\ Let h satisfy 

(2.17) Ah = 

and let 5*0 be a subset of {1, . . . , n} with cardinality i^So less than or equal 
to s. We partition Sq C {1, . . . , n} as 5*0 = SiU • • ■ U Si, where 5i is the 
set of indices of the s largest components, in absolute value, of h in ^q, 5*2 
is the set of indices of the next s largest components, in absolute value, of 
h in (^o U SiY, and so on. Applying the parallelogram identity, we obtain 
from the restricted isometry property ()1.5p that 

(2.18) KAu,Av)| <52s(A)||u||2||v||2 

for all s-sparse vectors u, v E S^ whose supports have empty intersection 
[7] . Combining (|2.17p and (|2.18p and using the restricted isometry property 
p3|) yield 

(l-<52s(A))(||h5j|i + ||hsJ|2) 

< (A(h5o+hsJ,A(h5o+h5,)) 

i>2 j>2 

< ^52.(A)||h5j|2||hs,||2 + 5]||hs,||i 
ij>2 j>2 

= S2s{A)[Y.\\hs^hy + Y,\\hs^\\l 

i>2 i>2 

(2.19) < (l + <52.(A))(^||hs,||2'' 

j>2 

which implies that 

V- . / l-,52.(A) V/2 

.1 + <52.(A) 



(2.20) EWHh^i : . T).i ) I|h5.||2. 



i>2 



-1-^2. (A) A 1/2 



Applying Lemma \2^ with 6i = { i,f (A ) gives 

(2.21) ^||h5j|2 <a(g,<^i)si/2-V.||h5g||^. 

i>2 
Then substituting the above estimate for X^,>2 ||h5j||2 into the right hand 
side of the inequality (j2.19p and recalling that h^g is an s-sparse vector lead 
to 
(2.22) 

j>2 ^ 
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the desired null space property. D 

2.2. Proof of Theorem 11.51 We follow the argument in [U [5]. Set h = 

X* — X, and denote by 5*0 the support of the vector x^ S S^, by Sq the 
complement of the set 5*0 in {1, . . . , n}. Then 

(2.23) II Ah||2 = II Ax* - Ax||2 < ||Ax* - y||2 + ||z||2 < 2e 

and 

('2 24') llhccll'' < llhe II'' -I- 2llx — X II'' 

V^-^^^ ll^^ogllq ^ ll"5o llg T^ ^11-'^ -'^sllij) 

since 

llx 11? -I- llx II'? — 11x11'' > llx*ll^ — llx -I- h 11^ -I- llx -I- h W^ 

ll-^sllg T^ ll-^sgllg ~ ll-^llg - 11-^ llg — ll-^s T^ "sollg ^ ll-^sg ^ "sgll? 

> llx 11^ - llh II'' -I- llhccll^ - llx II'' 
^ ll-^sllg ll^sollg + ll'i^gllg ll^sgllg- 

Similar to the argument used in the proof of Theorem 11.41 we partition 
5o C { 1 , . . . , n} as 5*0 = 5*1 U • • • U 5/ , where 5i is the set of indices of the s 
largest absolute-value component of h in Sq, S2 is the set of indices of the 
next s largest absolute- value components of h on ^q, and so on. Then it 
follows from ([13]), (l239l) and (12:231) that 

(l-52s(A))(||h5oi+||h5j|^) 

< (A(hso+hsJ,A(h5o+h5j) 

< (Ah-A(j;h50,Ah-A(^h5,)) 

i>2 j>2 

(2.25) < {2e + V^ + 62s{A)Y,\\Hhf- 

i>2 

By the continuity of the function a{q, 6) about 6 £ (0, 1) and the assumption 
(J1.14p . there exists a positive number r such that 

(2.26) a{q,6i/il+r))<5i/il+r). 

If Ei>2 IIHII2 ^ 2e/{ry/l + 62siA)), then it follows from ([221, (12:25]) 
and the fact that h^^ € Tig that 

||X*-X||2 = ||h||2<(||h5o||i + ||h5j|i)^/' + 5]||h5j|2 

i>2 

(2.27) < -f /^ + "^ I ' 



Vl - ^2s{A) ry/l + 62s{A)J ' 



and 



<? 



Ix*— xll'' < llhc II'' -I- llhccll'' < 2llhc 11"? -I- 2llx — X 
< 2s^"^/^llhe 11^ -^2llx-x 11^ 



g+q (1+r)'' l-q/2 q I g|| ng 

r''(l-52.(A))'?/2' ' +'11'' ^^ll«- 



(2.28) < 2^+g ^ ^ / ^^ ,„ s^-^/^e^ + 2||x-x. 
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If E,>2 llhs.lb > 2e/(rVl + (52s(A)), then 
(2.29) 6,{\\hs,g + \\hsAlf'<{l + r)Y,\\hs 



i>2 



by dOSD, where we set Si = ^^{1 - S2s{A))/{l + 62s{A)). Using ^TE^ and 
applying Lemma 12.31 with 6 = 6i/{l + r) give 

(2.30) ^||h5j2<a((z,5i/(l + r))si/2-i/a||h5g||^. 

i>2 

Noting the fact that h^,, G S^ and then applying (jTMj) . (j2:29]) and (p30|) 
yield 



a{q,6i/{l+r)) Y f a{q,6i/{l+r)) Y 

5,1 {I + r) ) "^^°"^ + H V(l + r) i """"^"^- 

This, together with (j2.26p . leads to the following crucial estimate: 

(2 31) llh. II'' < 2{a{q,5,/{l+rW . _ ^ n, 

^ ' ^ ll^^»ll^- (5i/(l + r))''-(a(,,<5i/(l + r)))^ll^ ^^H^' 

Combining OTMD . (I2:29D . (I230D and dOT]) . we obtain 

||X*-X||2 < (||h5oi + ||h5j|^)^/' + 5]||h5,||2 

i>2 
(2 32) < 2V''(l + r + ^i)(a(g,Ji/(l + r)))^ ^^,^,„,^ 

and 

||x*-x||^ < 2||h5o||^ + 2||x-x,||5 
..^^^ . 2(^i/(l+r))^ + 2(a(g,^i/(l+r)))'? „ _ 

^ ^ ^ - {5,l{l+r)Y-{a[q,6r/{l+r))Y " ^"''■ 



The desired error estimates (fTTGl) and (fTTTll follow from (f2:27D . (|2:28D . 
(12:32]) and (l2:33D . 

2.3. Proof of Theorem 11.21 The conclusion in Theorem 11.21 follows from 
Corollary 11.61 and the observation that 

(2.34) lim aiq,5) =0 

for any 5 G (0, 1). 
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2.4. Proof of Theorem [TTSl Let 

(2.35) Qmax(<Ji) = sup{q e (0, 1]| a{q, 5i) < 5i}. 

Take sufficiently small e > 0. Note that 

22/ 



sup 



1/9 



(2.36) 



V2{l-ro)5i/2<y<l (l + 2-9/2y2+g) 

' V2(l~ro)<5i 

(l+2-i-9((l-ro)<5i)2+9)''''' 

if g<2-'?(l-ro)2+552+9, 

gl/(2+g)^^ _^ |^-l/g2(l+3g/2)/(2+q) 

if 1 > g > 2-9(1 - ro)2+'?5^+9. 



Then for any small q > (e/2 + e)5^ and sufficiently small 6i > 0, we have 
that q > 2-9(1 - ro)'^^'^ d^^" for all ro G (0, 1). Then applying (frT2|) and 
(12:36]) yields 

o-{q,6i) > inf sup -j- 

0<^"<l V^(l-ro)5i/2<y<l (l + 2-'?/2y2+g) V? 

= gV{2+g)(i _^ ^^-l/'^2(l+3<?/2)/(2+g) 

> (l + e/e)i/25i, 
where the last inequality holds since 

(2.37) limg-9/(4+29)(l + ^)-i/'?2(i+3./2)/(2+,) ^ (2/e)i/2. 

Therefore 

/oqo^ r gmax('5i) ^ ,. (e/2 + e)5f e 

(2.38) limsup "2 < hmsup -^ < — he 

for any sufficiently small e > 0. 

Take ro = 1 — V^/4 and sufficiently small e > 0. Then for q < (e/2 — e)(5f 
and sufficiently small 5i > 0, 
(2.39) 
f (1 + ro5i)(l + r^^?)-!/^ < 2(3/2)-!/'? < (l _ e/e^/Hi, 

supj^>i y(l + y)-i/9 < sup^>i(l + yy-^'^ < 2^-^/" < (1 - e/e)i/25,/2, 

1^ SUPj^>V2(l-ro)5i/2 (l+y)!/. - (l+v/2{l-ro)5/2)V9 ^ ^^ ^/e'' ^'V"^' 
and 

(2.40) sup ^^ -r < (1 - e/e)i/2^i 

V^{l-ro)5i/2<j/<l (1 + 2-9/2y2+q-) V? 

by (frT2D . (12:36]) and dOT]) . Therefore 

(2.41) hm inf %^ > lim sup ifZ^-M > £ _ ^ 
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by (fTM]) and (pliOj) . Combining (f2:38|) and (EJT\\ and recalling that e > 
is a sufficiently small number chosen arbitrarily, we have 

(2.42) lim ^E^4^ = ^. 

By Corollary 11.61 we have 

(2.43) g„iax(5; m, n, s) > ^max(\/(l - <^)/(l + (^)). 

This together with (|2.42p implies that 

(2.44) 

,. . r qmi,x{S;m,n,s) ^ gmax(V(l -'^)/(l +S)) ^ 1 ^ e 

Hi- l-<5 -5™- (l-^)/(l + (5) ^l + 5~4' 

and hence completes the proof. 
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